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While it is generally assumed that the use of microcomputers helps to improve productivity in an office 
environment, quantitative measures in this area are lacking. This paper addresses the measurement of the 
effect on productivity in an end user, office environment as a result of the introduction of micromputer-based 
technology. It is concerned with defining how productivity can be measured in such an environment and with 
current efforts to measure changes in productivity. It identifies and assesses the various techniques and 
measures used to describe the magnitude of productivity improvements that result from the use of micro- 
computers in the workplace, and makes recommendations for ways in which changes in productivity, may be 
measured. 
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Introduction 

The role of information processing has changed with 
the introduction of the microcomputer into the work- 
place. The microcomputer has become a "tool" that 
often enables the user to directly control information 
processing needs without the assistance of the profes- 
sional ADP staff. The relative low cost of micro- 
computers, their adaptability to various applications, 
and the availability of software which is useful to non- 
computer professionals has resulted in the proliferation 
and use of microcomputers in the office environment. 

While there is general agreement that micro- 
computers do increase office productivity, there is little 
hard, quantifiable data to actually support this claim. 
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Many companies have published reports of substantial 
improvements to productivity, but few have attempted 
to actually measure the changes, and fewer still have 
achieved any reliable measurements. By and large, the 
published reports have drawn the conclusion of pro - 
ductivity gains based on the perception of the managers 
and workers in the affected office environments. 

The use of microcomputers by professional and cler- 
ical staffs overlap but are functionally different. The 
clerical staff primarily utilizes word processing which 
can be measured at the individual level (e.g., number of 
words in within a specific period). It appears, however, 
that the primary benefits to the professional staff are not 
in speeding up the information flow, but in improving 
the depth of analysis and understanding of the available 
information. Therefore, professional staff productivity 
should be measured in terms of the information handled 
and processed. Through spread sheet analysis and ac- 
counting and financial systems, the professional can bet- 
ter understand the significance of the information and 
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thus, can make more informed decisions which result in 
improved performance of the entire organization. 

This paper addresses the measurement of the effect on 
productivity in an end user, office environment as a 
result of the introduction of microcomputer-based tech- 
nology. It analyzes and assesses the various mea- 
surement techniques presented and makes recommen- 
dations on how to measure productivity gains in the 
functional workforce. Measuring productivity changes 
in an office environment primarily involves the assess- 
ment of the impact of new technology on qualitative 
factors which cannot be measured directly. Thus, the 
inability to assign a numerical value to a factor such as 
"efficiency" limits the measurement and makes it highly 
subjective. In general, if the product or service is com- 
pleted faster; if the quality and performance is im- 
proved; if there are noticeable, desirable differences in 
the process; then there are productivity gains for the 
organization. 

Productivity is often equated with efficiency (reduc- 
ing unit costs, improving output per hour, reducing er- 
rors, etc.) or quantity of work performed. Quality of 
output may, in fact, be far more important than quantity 
when measuring and assessing traditional white collar 
worker performance since accurate communication of 
information is the primary function of such workers. 
The usefulness and effectiveness of this output is deter- 
mined by such qualitative characteristics as "effi- 
ciency," "completeness," and "effectiveness." Al- 
though these attributes are discernible to those 
involved, they are not directly measurable and thus, an 
assessment of changes in productivity is much more 
difficult to make. Productivity measurement can be 
facilitated if the input properties and the output proper- 
ties are clearly defined. This is more difficult to do in a 
white collar environment since most managerial and 
professional work does not have well-defined, mea- 
surable inputs or well-defined outputs. Thus, the use- 
fulness of any productivity measurement is dependent 
upon the accuracy of the perceptions of the qualitative 
factors which are used. 

The introduction and use of microcomputers have 
increased the productivity of users, but measuring these 
increases has not been easy. Much of the difficulty is due 
to the fact that techniques for measuring productivity 
are neither well-known nor well-defined. Further, the 
benefits do not always appear as single, discernible enti- 
ties, rather they are often small gains across many tasks. 
As a result, few organizations have initiated productiv- 
ity measurements citing the lack of money, time, knowl- 
edge, or an inclination to perform a comprehensive, 
scientific study. The situation is further complicated by 
the lack of information needed to measure productivity. 



One of the perennial problems is the difficulty in mea- 
suring the productivity of value-added activities. In- 
evi tably when a manual system is automated, many new 
functions and products are generated, usually without 
additional resources and at negligible cost These intan- 
gible byproducts of automation, which did not exist pre- 
viously, can enhance a manager's decision making abil- 
ity. Another problem in measuring productivity gains is 
the omission of some of the cost of converting from 
manual to automated methods, and a comparison of 
these costs against the benefits. Some of the costs typi- 
cally omitted are site preparation, training, and ongoing 
software maintenance. Quantifying professional or man- 
agerial productivity has proven to be difficult, particu- 
larly for such activities as: preparation for and attending 
meetings, reading and writing reports, responding to 
telephone calls, etc. 

Prior to implementing a productivity measurement 
program, there are a number of factors to be considered. 
While the methodology (presented in table 5) is recom- 
mended for measuring changes in productivity, it may 
not be feasible depending on organizational constraints. 
These constraints include: 

• the unavailability of measurement data/ 
information. It is difficult to measure changes in pro- 
ductivity in the absence of baseline data. If the informa- 
tion needed to conduct such a study is incomplete or 
unavailable it may be better to rely on the judgement of 
the users of the microcomputers. 

• the lack of well-defined productivity measurement 
techniques. Measures of productivity that are appropri- 
ate for the different levels and functions in the or- 
ganization must be well-defined. 

• the cost, time, and effort to effectively measure 
productivity. 

• the lack of a means to capture much of what is 
done in an office environment. 

• the size of the organization or project, and the 
type of applications. If the environment is small, the cost 
of such a study could outweigh the benefits. 

• the lack of (active) participation in the pro- 
ductivity measurement program by all impacted by the 
introduction of microcomputer. 

Once the decision has been made to measure changes 
in productivity, it is often desirable to implement a pro - 
ductivity improvement program to maximize pro- 
ductivity gains resulting from microcomputer use. 

Quite simply, organizations are as concerned with 
what a productivity program is going to cost as with 
what it is going to return. Knowing how to spend funds 
where the most benefit can be realized, however, is 
sometimes difficult. Before productivity can be effec- 
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tively measured, there must be a thorough under- 
standing of what is being done, the activities performed, 
for whom, and why. While the old maxim, "you can't 
improve what you can't measure" is not entirely true, it 
is important to develop a strategy for defining what to 
measure, when to measure, and how to use the mea- 
surement data. 

As the activities performed in the functional work- 
place become more complex and technical in nature, 
and ready access to reliable information becomes more 
critical, it is essential to make better use of each individ- 
ual's time. The effectiveness of any productivity mea- 
sure is how accurately it reflects what is taking place 
with respect to the ability of the individual, and ulti- 
mately the organization, to perform tasks easier, faster, 
and better. 



Measuring Changes in Productivity 

Techniques for measuring changes in productivity 
rely on two types of measurements: quantitative and 
qualitative. Quantitative techniques generally measure 
quantities of work over some unit of time such as "pieces 
per hour," "person-hours per completed product," or 
"defects per unit of time." These types of measurements 
are fairly easy to quantify and are typical of mea- 
surements made when investigating productivity 
changes in a production, blue-collar environment. Qua- 
litative techniques are those which address less tangible 
attributes such as "quality," "effectiveness," and "effi- 
ciency." Measurement of such attributes is very difficult 
because it is highly subjective. 

Assessing productivity and changes resulting from 
the introduction of microcomputers primarily requires 
the measuring or estimating of qualitative attributes 
rather than quantitative factors. While it is not possible 
to obtain highly definitive qualitative measurements, it is 
possible to assess the relative changes in productivity 
through a careful and consistent assessment of selected 
qualitative attributes before and after the introduction of 
the new technology. 

Measuring changes in productivity can be done at the 
global (organization), local (functional unit), or individ- 
ual level. Measurement of quantitative factors can be 
successfully performed at the lowest individual levels 
since exact counts can be obtained for specific factors 
(number of letters typed, hours worked, number of 
forms processed, etc.). Assessment of qualitative attri- 
butes, however, is more reliable at a higher level within 
an organization since the individual variances and in- 
consistencies will tend to balance out. 



Based on the literature search which was conducted 
as part of this task, there is a great deal of interest in 
productivity measurement in general and the effects of 
microcomputers on productivity in particular. This lite- 
rature search included more than 200 sources, of which 
47 appear at the end of this paper as a selected bibli- 
ography. Many organizations have initiated efforts to 
determine the effects of microcomputers on individual 
and organizational productivity. However, there is a 
dearth of information on any actual quantifiable 
changes. These reports consistently discuss the diffi- 
culties in performing such measurement and usually 
conclude that there has been improvement in pro- 
ductivity on a global level as a result of the introduction 
of microcomputers. 

Some of the techniques discussed later in this section 
have been proposed to provide quantifiable mea- 
surements. Organizations have been reluctant, however, 
to embark on the effort required to make such mea- 
surements citing the cost, lack of time, lack of informa- 
tion, and lack of proof that these techniques will actually 
provide useable results. Thus, the consensus is that mi- 
crocomputers have improved productivity, but there is 
little actual documentation to support that conclusion. 



What Should be Measured 

Productivity measurement, particularly of qualitative 
items, can be a costly endeavor. In a small organization 
with limited resources, it may be unreasonable to under- 
take a comprehensive study either to determine pro- 
ductivity gains or to determine how achieve to them. 
Regardless of the size of the organization, it may be 
determined after a careful evaluation of organization 
goals, objectives, and requirements that the difficulty of 
implementing a productivity measurement program just 
would not be cost effective. Another instance in which 
a program to measure changes in productivity may be 
unnecessary is when it is obvious that the use of micro- 
computers has resulted in improved productivity. 

The attributes and factors to be measured must be 
selected and carefully defined. Since each organization 
is unique, the attributes and factors selected for mea- 
surement will differ. After the technology has been in- 
troduced, sufficient time should transpire before con- 
ducting the second productivity measurement. This is 
important because there may be a short-term decline in 
productivity which occurs while the users are learning 
to use the new technology properly. The baseline and 
new productivity levels should then be carefully evalu- 
ated and an assessment made on the relative pro- 
ductivity changes which have been realized. 
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Factors that complicate measurement. Several factors 
frequently complicate the measurements: 

• Value-added activities may not be adequately 
measured. When a manual system is automated, many 
new functions and products may be generated without 
requiring additional resources or cost. These activities, 
while difficult to measure, should be taken into consid- 
eration. 

• A number of cost factors are frequently omitted 
when measuring productivity gains. Included are those 
costs associated with the conversion from manual to 
automated procedures such as: site preparation, training, 
and maintenance of both the hardware and the software 
systems. 

• The introduction of new technology frequently 
results in substantial changes to the office environment. 
Personnel become responsible for different or additional 
parts of the process, duties shift, and some work may be 
eliminated while new work is created. Thus, attempts to 
measure individual productivity changes is often a case 
of comparing apples and oranges. For this reason, the 
assessment should be made at the organizational level 
rather than the individual level. 

Factors and attributes for measuring productivity. The 
following three tables list some of the more commonly 
used factors and attributes used in evaluating pro- 
ductivity Table 1 identifies tangible, quantitative factors 
which can be measured directly. Table 2 and table 3 

Table 1. Factors that can be measured and quantified to determine 
productivity gains, 

- workload 

- schedules 

- cost/budget 

- end products 

- training cost 

- size of staff 

- methods/techniques 

- response/turnaround time 

- time to perform a specific task 

- number of new requests/alternatives examined 

- outputs before and after using microcomputers 

- amount of data handled, sorted, and calculated 

Table 2. Attributes which can be measured but not easily quantified 
to assess productivity gains. 

- accuracy 

- efficiency 

- reliability 

- completeness 

- user acceptance 

- data accessibility 

- value added capabilities 

- improved analysis {budget, trends, etc.) 

- timeliness of reports/tickler files/information 



identify less tangible, more subjective, qualitative attri- 
butes which should be assessed in attempting to evaluate 
the productivity of an organization. Section three pro- 
vides a discussion of several case studies which make use 
of many of the factors and attributes identified in the 
tables below. 

The productivity improvements most frequently 
mentioned as a result of using microcomputers are in- 
creased workload, new or more work accomplished in a 
shorter time, and cost saving. Improved accuracy, effi- 
ciency, quality, attitude and morale are also cited as 
benefits of microcomputer use. Not all of factors and 
attributes identified may be appropriate to a specific 
situation, while others not found in these tables may 
be critical in specific environments. 

Criteria to measure desired outcomes. The ultimate 
objective of introducing microcomputers is to increase 
the productivity of an organization. This may be accom- 
plished by reducing costs, avoiding increases in costs, 
increasing value added activities/products, increasing 
employee satisfaction or becoming more competitive. 
Our findings indicate that the identification of desired 
outcomes and the selection of appropriate measurement 
criteria are essential to the success of any productivity 
measurement program. The desired outcome, more than 
any other factor, influences the choice of criteria for 
measuring the outcome and determining if goals have 
been achieved. Table 4 identifies some possible criteria 
for different objectives and goals. 



Measurement Techniques 

Measurable improvements in productivity generally 
can be attributed to a combination of human resource 
and technological factors. Therefore, any effort to de- 
termine changes in productivity as a result of the intro- 
duction of microcomputers should consider both the 
work environment (equipment and tools) and the em- 
ployee effectiveness (training, education, attitude). 

There are few effective measurement techniques 
available for measuring productivity in the office envi- 

Table 3. Attributes which are not easily measured nor quantifiable to 
determine productivity gains. 

- control 

- flexibility 

- communication 

- attitude and morale 

- quality of decisions 

- new insights and learning 

- better understanding of business 

- effectiveness (of team work, etc.) 

- quality of presentations (graphic displays, etc) 
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Table 4. Criteria to measure desired outcomes for OA projects. 



Desired Outcome 



Possible Criteria 



To increase organizational 
productivity 



To reduce or avoid costs 



To increase value-added 
with products/services 

To increase managerial 
productivity 



To increase timeliness 
of information 

To increase quality af 
information 



To provide more job 
satisfaction 



Total output in number of units 
produced as a function of 
labor, investment, etc. measured 
in dollars 

Cost of labor, materials, and 
overhead 

Contribution to profits from 
improved products/services 

Time required to complete tasks 
and level of individual, unit, and 
organization productivity 

Average and variance of time to 
prepare/distribute information 

Quality, accuracy, and com 
pleteness of information 
used to generate products 

Turnover or absenteeism 



ronment. The qualitative measurements which are most 
useful in assessing changes in the office productivity are 
most difficult to obtain. The quantitative measuring 
techniques can be characterized as a comparison of 
INPUT/OUTPUT before and after microcomputers 
are used. Although the INPUT is generally well-de- 
fined, the difficult aspect in performing this type of mea- 
surement in the functional workplace is quantifying the 
OUTPUT. 

The most commonly used techniques for measuring 
changes in productivity are Questionnaires and Empir- 
ical Analysis (see table 5). The primary difference be- 
tween these two approaches is that the latter relies more 
on intuitive knowledge and information gained through 
experience and less on a systematic, structured meth- 
odology. Both of these techniques make use of before 
and after information concerning the qualitative and 
quantitative aspects of the process and the products; 
both are relatively easy to employ; both can be adminis- 

Tablc 5. Productivity measurement techniques. 



Questionnaire/Surrey 



Empirical Analysis; 



- Before and after ' 

measurement 

- Assessment of need 

- Quantitative metrics 

- Qualitative measures 

- Methodology /formula 



- Before and after 

measurement 

- Intuitive 

- Quantitative metrics 

- Qualitative measures 



1 The establishment of a baseline level of productivity prior to the intro- 
duction of the new technology is essentia] 10 the success of a "before and after" 
assessment. 



tered formally or informally; and both can be used for 
almost any size and type of environment/organization. 

Questionnaire technique. The questionnaire/survey 
method of assessing changes in productivity resulting 
from the introduction of microcomputers appears to be 
one of the most useful. One of the advantages provided 
by the technique is that it can readily be adapted to 
measure global, as well as localized changes in pro - 
ductivity. The questionnaire can be used to gather infor- 
mation about characteristics and functions of the or- 
ganization; projected requirements and desired features; 
work process, equipment, and products; and profile data 
on individual performance. It can also be used to isolate 
problem areas, determine employee attitudes, and solicit 
suggestions. 

Another advantage provided by the questionnaire/ 
survey method is that it can be used to obtain informa- 
tion from multiple levels of the organization. This ap- 
proach makes it possible to obtain information about 
perceived qualitative, as well as quantitative changes in 
productivity. This is essential since the perceptions of 
the changes may differ. In fact, everyone who either 
uses microcomputers, or is impacted by changes in the 
environment as a result of their use, should be surveyed. 
Properly employed, it is one of the most effective tech- 
niques for obtaining, comparing, evaluating, and mea- 
suring changes in productivity within the organization. 

Empirical analysis measuring technique. Empirical 

analysis is employed to measure productivity before and 
after the introduction of microcomputers in the work- 
place. Empirical analysis relies primarily on experience 
and observations about a particular area or environ- 
ment, and does not generally make use of systematic 
methods or methodologies. It may be performed by 
weighing and measuring the applicable, quantitative or 
tangible factors such as those identified in table 1. The 
weights are generally assigned to the variables to be 
measured based on the value and function of that vari- 
able within the specific environment. Qualitative factors 
may also be taken into consideration. Using empirical 
analysis, a baseline is established against which all 
changes are measured. 

Recommendations on measurement techniques. When us- 
ing either the questionnaire or the empirical analysis 
technique to measure productivity, it is important to 
focus on the extent of productivity changes at the global 
level, as opposed to the short term or incremental in- 
creases at the local level. The introduction of any new 
technology involves a learning period during which 
there may actually be a decline in productivity. Con- 
sequently, sufficient time must be allowed after micro- 
computers are introduced into the organization to per- 
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mit a stable state of operation to be established before 
the productivity impact is assessed. The usefulness of 
these techniques is dependent upon the accuracy and 
completeness of the information collected, and the skill 
and knowledge of the surveyor or evaluator. 

Table 6 contains a set of recommended steps which 
should be followed in measuring productivity changes 
in an office environment. 

Methodology for Measuring Productivity 

There are a number of approaches for determining a 
methodology for measuring productivity changes. One 
approach is to evaluate attempts by other organizations 
to measure productivity, while another is to determine 
the estimated cost of such a program, and then compare 
this cost with the expected gains in productivity. 
Whether or not either of these methods are employed, it 
is essential to determine the goals or desired outcomes of 
a productivity measurement program for the specific 
office environment. See table 4 for some desired out- 
come measurement criteria. 

Preparing to measure change. The first step in pre- 
paring to measure changes in productivity after defining 
the goals is to determine the feasibility of such a pro- 
gram. This requires that those involved have a thorough 
understanding of what is meant by productivity, of the 
activities to be measured, and of the areas likely to ben- 
efit most from the application of productivity measures. 
Since productivity has different meanings in different 
environments, it is essential to establish a definition that 
is suitable for the environment that is to be measured. 
Each environment is unique and the attributes and 
factors useful in one may not be appropriate for another. 
This is especially true in the case of qualitative, subjec- 
tive attributes such as reliability, accessibility, and effi- 
ciency. Therefore, it is necessary to define not only a set 
of factors and attributes (productivity indicators), but a 



method for quantifying the qualitative attributes. It is 
also essential that changes in productivity be measured 
at the global or organizational level, as well as the local 
or individual level to ensure the least amount of bias. If 
there is little or no assurance that a program to measure 
changes in productivity can be justified from a budget- 
ary standpoint, the costs are likely to outweigh the 
gains. Finally, if it is determined that the implementation 
of such a program is not feasible, then planning should 
cease. 

Performing Measurements. Once the decision has been 
made to proceed, it is essential to establish and measure 
the baselined activities before and after microcomputers 
axe introduced. After a sufficient time has elapsed, there 
should be a careful assessment and evaluation of any 
changes in productivity. This process should be re- 
peated over a period of time at unscheduled intervals at 
sufficiently high levels within the organization to pre- 
clude constraints and otherwise, unrepresentative con- 
clusions. Table 6 describes a methodology for both pre- 
paring for and performing productivity measurements. 



Case Studies 



As part of our study, we surveyed a number of or- 
ganizations to determine their experiences in measuring 
productivity. We found that: 

* Virtually every organization reported substantial 
gains in productivity. 

* Most organizations and studies which reported 
gains in productivity from the use of microcomputers 
based that claim on a perceived improvement and the 
subjective judgment of management 

* Actual, quantitative measurement studies were ei- 
ther not conducted or did not yield quantifiable results. 



Table 6. Steps in measuring changes in productivity. 



A. Planning and Preparing to Measure Change 

1. Determine the feasibility of measuring productivity changes in the specific environment. 

2. Develop a definition of productivity fat the specific organizational environment. 

3. Identify the attributes to be used in measuring productivity and define a method of quantifying the subjective qualitative attributes. 

4. Develop and implement productivity measures at the global or organizational level rather than at an individual level to ensure a 
reliable assessment 

B. Performing Measurements 

1. Perform a measurement to establish the baseline productivity level. 

2. Introduce the new technology. 

3. Permit a sufficient period of time to elapse to allow any short term decreases in productivity to be eliminated. 

4. Re-measure the productivity levels. 

5. Carefully evaluate the results to Ensure that the results are interpreted within the context of the organizational environment. The 
evaluation should be performed at the highest, global level possible to avoid local aberrations and biases. 
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This section present* the findings of eight esse studies. 
Five of these are based on reports which are listed at the 
beginning of each case study, and three on information 
obtained directly from the organization. Table 7 pro- 
vides a matrix which identifies the factors and attributes 
referenced in each of the following case studies. 

While these eight case studies provide some insight on 
the different approaches used to determine changes in 
productivity, they demonstrate the difficulty in identi- 
fying and measuring subjective attributes. Each of the 
case studies reference increased workload, new or more 
work accomplished in shorter time, and cost saving as a 
result of using microcomputers. In many environments, 
microcomputers are credited with increasing pro- 
ductivity if schedules are met in a timely maimer, if the 
workload is handled without additional staff, and if the 
products are acceptable and of high quality without the 
benefit of any "formal" measurements. Table 7 lists fac- 
tors or indicators identified in the selected case studies: 

As indicated, very little quantitative data is available 
and most of the conclusions of improved productivity 

Tabic 7. Case Study Matrix. 



Firm Table 1 Factors 


Table 2/3 Attributes 






Measured 


Assessed 


1. 


NSRDC 


workload 


timeliness 






stafT 


efficiency 






time 


quality 






etc. 




X 


GAO 


workload 


improved analysis 






manpower 


efficiency 






oost 








iLTimfoer hours 








data handled 




3. 


GSA 


manpower 


qualitative benefits 






cost 


timeliness, etc 






workload 








etc. 




4. 


uss 


costs 


users/mgrs. best judge 






workload 


of how much productivity 






etc. 


is achieved (no detail) 


5. 


American Productivity Center 






Bethlehem Steel 




improved morale 

timeliness 
communication 
reliability 
(errors reduced) 
quality of life 
teamwork 




Polaroid 


costs 
workload 




6 


Banking 


cost 






Data Processing 
and Research 
time 


workload 


value-added capabilities. 


s. 


Brokerage Finn 


cost 


user acceptance 



are based on intuitive belief, not on firm, scientific mea- 
surement. 

1. Nflral Ship Research And Development Center 

Van Eseltine, R.T., "The Scientific/Engineering 
Workstation Experiment: Plans and Progress," Pro- 
ceedings of the 22nd Annual Technical Symposium of 
the Washington, DC, Chapter of the ACM, Co- 
sponsored by the National Bureau ofStandards, 
June 1983, (Questionnaire and Empirical Analysis) 

As part of the Technical Office Automation and 
Communication (TOFACS) project, the David W. Tay- 
lor Naval Ship Research and Development Center has 
undertaken a study of the effects of individual scientific/ 
engineering workstations (SEWs) on the productivity of 
scientists and engineers. A prototype network of SEWs 
was developed to assess the changes in productivity 
which, could tesult from the introduction of SEWs. Ini- 
tial results of this research indicate that workstations are 
viable tools which aid productivity in a scientific and 
engineering environment. 

The technique used in this study was to have the 
subjects being studied perform the evaluation and as- 
sessment of their before and after productivity levels 
for a brief description of the methodology employed. A 
rather complex formula was used which basically in- 
volved applying values to attributes before and after the 
introduction of the workstations, and then calculating 
the change in the ratio of the Output to Input totals. 
Quantitative data was gathered by having the technical 
staff assess the changes in how long it took to complete 
a typical task with and without the scientific and en- 
gineering workstation. Most of the other data was more 
subjective (qualitative) in nature and less easy to quan- 
tify. The use of the subjects to evaluate their changes in 
productivity resulted in more consistent assessments on 
an individual basis, but may have also introduced biases 
which could affect the findings. In general, this method 
appeared to work satisfactorily in this R&D laboratory 
environment and the general methodology could be ap- 
plicable to other similar measurement attempts. 

2. General Accounting Office 

"Workstation Project Report To Information Pol- 
icy Committee," Directed by Kenneth Pollock, As- 
sociate Director of Information Management Sys- 
tems, General Accounting Office, Internal Study, 
1982. (Questionnaire) 

The GAO initiated an electronic workstation project 
to determine if the installation of workstations "could be 
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cost effective at GAO in performing various auditor 
functions." The auditing (workload) functions are de- 
scribed and activities are divided into categories for the 
purpose of measurement. Benefits and problems are dis- 
cussed. A matrix of automatable and non-automatable 
activities was defined and provided the basis for deter- 
mining how best to utilize the workstations. 

This report discusses the study and the methods em- 
ployed and concludes that an approximate 25% increase 
in the capacity to perform audit functions was realized 
as a result of the introduction of the electronic work- 
stations. The basic measurement unit utilized was the 
number of staff hours actually needed versus the esti- 
mated number of hours 'which would have been re- 
quired if the electronic workstation had not been intro- 
duced. The report contains little information on the 
actual collection and analysis of data. 

3. Genera] Services Administration 

"Final Report on the GSA End User Computer 
Pilot Project," Prepared by The General Service 
Administration's End User Computer Support 
Staff (KGS-1), September 28, 1983. (Empirical 
Analysis) 

The General Services Administration conducted a pi- 
lot project to study the effects of the introduction of 
microcomputers within GSA. The project involved 500 
GSA employees using 53 microcomputers and consisted 
of the automation of 175 applications. The report pro- 
vides information on the experiences during the project 
and identifies the actions completed or initiated to facil- 
itate end user computing. The report summarizes both 
the qualitative and quantitative benefits encountered by 
the end users. Most improvements were a result of auto- 
mating manual operations. Specific examples of pro- 
ductivity gains are given in terms of cost savings, man- 
hours, and increased workloads/tasks. 

In discussing the findings, the report notes that in 
some cases productivity increases were measured "in 
terms of staff hours, or dollars," but in others they were 
not quantifiable because "the microcomputers satisfied 
requirements that were previously postponed due to 
staffing shortages." Direct changes in productivity were 
measured in terms of changes in staff hours or dollars 
whenever possible. 

However, most of the conclusions drawn in this re- 
port are based on qualitative estimates of perceived im- 
provement to the process. Nevertheless, there is a very 
strong indication that "the use of microcomputers can 
pay for themselves in less than one year" and can "help 
provide better, more timely products and more in-depth 
analysis." 



4. United States Senate 

"The Pilot Test of Office Automation Equipment 
in the Offices of United States Senators," Commit- 
tee on Rules and Administration United States Sen- 
ate, S-Prt 98-120, November 1983. (Questionnaire, 
Empirical Analysis, and Before/After Measure- 
ment) 

This pilot study focused on office automation in the 
U.S. Senate offices. The method used to measure pro- 
ductivity gains was a before and after analysis of the 
functional requirements and the day-to-day office work- 
load. Participants were asked to complete forms which 
identified the areas that could be improved most by 
automation. They were also asked to rank each of the 
areas in terms of importance to the performance of then- 
responsibilities. Guidelines were developed to ensure 
that everyone recorded the same types of information in 
assessing changes as a result of automation. The key 
aspect of the productivity measurement program was 
the requirement that productivity goals and cost justifi- 
cation be established for each workstation to be in- 
stalled. 

The test demonstrated that the staff could quickly 
learn to use the equipment and put it to productive use. 
The report does not present any detailed information oh 
measuring productivity changes but does state that "in 
the final analysis, the actual users and office managers 
are the best judges of how much improvement has been 
achieved." 



5. American Productivity Center 

Steel, "White-Collar Productivity: The National 
Challenge and Case Studies," sponsored by Steel- 
case Inc., Grand Rapids, Michigan, 1982. (Ques- 
tionnaire and Empirical Analysis) 

Steelcase Inc. commissioned the American Pro- 
ductivity Center, a nationally recognized expert on pro - 
ductivity issues, to conduct a study on productivity in the 
workplace. During this six month study, the Pro- 
ductivity Center sent survey questionnaires to 600 U.S. 
firms and received 140 responses, The study is based on 
those responses and includes 25 case studies selected on 
the basis of the techniques used to assess and measure 
productivity gains resulting from the introduction of 
office automation. While this study does not identify any 
unique measurement techniques, it does suggest that al- 
most any productivity improvement program, no matter 
how unstructured, can result in increased productivity. 
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Word processing was found to be the most effective 
factor in improving office productivity. Other factors 
consistently cited were team building and the work en- 
vironment. The productivity measurement programs of 
two of the most representative case studies are described 
and evaluated below: 

a) Bethlehem Steel (Methodology/Intuitive). Beth- 
lehem Steel initiated a Productivity through Office Sys- 
tems (PROS) effort to improve productivity of the 
400 person sales force and their support personnel. The 
thrust of PROS, which was aimed at the secretarial 
force, involved the introduction of both an office auto- 
mation system and a "Quality of Work Life" (QWL) 
methodology. The QWL methodology program en- 
courages greater employee participation, and provides 
for training in all aspects of an office that contribute to 
the "quality of life" in the office. As part of this effort, 
monthly PROS meetings were held to address team 
building, problem solving, and other issues which can 
strengthen employee capabilities. No formal techniques 
or measurements were undertaken either before or after 
the office automation system was installed. There is a 
strong perception, however, that there were substantial 
gains in productivity which could be attributed to both 
office automation and to the QWL methodology pro- 
gram. The reported subjective estimates of the pro- 
ductivity improvements were: 



increased output 
more timely delivery 
credibility of offices 
morale improved 
task difficulty reduced 
communication improved 
space more effectively used 
response time reduced 
errors reduced 
quality of service enhanced 



20% 
80% 
20% 
20% 
20% 
50% 
25% 
80% 
5% 
50% 



b) Polaroid (Needs Assessment). Polaroid, spurred 
by a reduction of 4000 employees between 1978 and 
1982, established an Office Technology Council to de- 
termine how to "better manage and utilize emerging 
office technologies, reduce cost and enhance the effec- 
tiveness and productivity of personnel," As a first task, 
the Council developed and implemented a seven-step 
"Needs Assessment Methodology" to justify the acqui- 
sition of new technology. An examination was made of 
the personnel, workload, and tools needed within the 
organization to accomplish its mission; data was gath- 
ered and evaluated; and a summary of the qualitative 
benefits expected from the application of electronic 
technology was made. Polaroid considers this type of 
assessment helpful in identifying methods for improving 



productivity prior to the introduction of new tech- 
nology. The seven steps of the methodology are: 

a) Orientation (Overall mission, functions, needs, 
equipment, costs) 

b) Professional activity profile 

c) Administrative profile 

d) Administrative reporting 

e) Detailed workload 

f) Word processing benefits summary 

g) Financial Analysis worksheet 



6. Banking (Empirical Analysis) 

A large northeastern bank is currently using 75 micro- 
computers for such varied applications as*, budget and 
financial analysis, gas and oil studies, balance sheet re- 
porting, and custom tailored accounts. Although a for- 
mal study has not been conducted, this firm believes that 
significant gains in productivity have been achieved and 
that microcomputers have proven to be very cost effec- 
tive. 



7. Data Processing and Research 
(Empirical Analysis) 

A large data processing firm provides service for the 
50 major U.S. banks in the country. Some of the applica- 
tions handled by the firm include; a significant amount 
of file transfer — from micro to mainframe; extensive 
word processing; budget analysis; and value added pro- 
cessing. A much greater workload (volume of trans- 
actions) is now being handled in a shorter period of 
time due to the use of microcomputers. No formal study 
has been conducted, but it is accepted by the firm that 
the use of microcomputers has resulted in increased 
productivity. 



8. Brokerage Finn (Empirical Analysis) 

A large New York brokerage firm makes extensive 
use of microcomputers to handle customer accounts 
around the country. While no formal studies have been 
undertaken, customers have indicated that the use of 
microcomputers generally results in productivity gains 
and that the replication of successful microcomputer 
applications would increase both productivity and cost 
effectiveness. Overall, this firm has been successful in 
the introduction of microcomputers. However, con- 
cerns were expressed that there may not always be suf- 
ficient control and coordination of this process. 
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As stated in the introduction to this section, two dis- 
tinct conclusions can be drawn from the available infor- 
mation on the measurement of the effect on productivity 
from the introduction of microcomputer-based tech- 
nology into the office environment. 

• Nearly everyone claims to have obtained signifi- 
cant improvements in productivity. 

• Virtually no one has successfully measured and 
quantified those changes. 

There is strong, anecdotal, circumstantial evidence 
that most of the claims of increased productivity are 
correct. There is, however, little reason to accept the 
specific percentages which are cited. Nevertheless, the 
strong perception of improved productivity has been 
sufficient to justify the further acquisition of micro- 
computers in many organizations. 



Improving Productivity: Management 
Considerations 

Once the meaning of productivity is understood, the 
next step is to ensure that the environment is conducive 
to the performance of high quality work, and that the 
responsibilities for a high level of productivity are well- 
defined. Individuals should have a clear understanding 
of their job responsibilities and should be held account- 
able for results. They must be made to feel that they 
make a difference. If productivity is a major or- 
ganizational concern, then the individuals within the 
organization must also be a major concern. This implies 
that there must be a feeling engendered among the 
workers that they are: valued, trusted, challenged, mak- 
ing a contribution, and involved in decisions affecting 
them. 

Increases in productivity and profitability, however, 
cannot be achieved simply with acquisition of new and 
better technology. Such acquisitions should be accom- 
panied by a management commitment to implement a 
cost-Justified, strategic, system integration approach 
which addresses the human or social aspects of auto- 
mation on both the individual and the organization. Too 
often, productivity has little or no meaning for the indi- 
vidual since it is viewed as an attempt by management to 
impose more procedures and controls, and ultimately, 
more wort with little additional remuneration. There is 
likely to be little incentive to use new tools and tech- 
niques or to improve performance, if a feeling exists that 
productivity measures are only being taken to increase 
the organization's image or profits at the expense of the 
worker. 



Improvements in productivity require upper manage- 
ment to play an active role in the productivity im- 
provement program and also requires that the affected 
individuals realize benefits from the changes. The intro- 
duction and use of microcomputer and related hardware 
and software must be accompanied by proper and ade- 
quate training and regard for the individual's working 
environment. 

In order to achieve significant productivity gains, 
there must be an integrated, cost-justified, program de- 
signed to achieve improvements in predefined areas 
which would benefit most by the improved pro- 
ductivity. The areas most frequently cited as being in 
need of improvement are: management, incentives for 
individuals, work environments, tools, training, soft- 
ware quality and software maintenance. Therefore, the 
initiation of a comprehensive productivity improvement 
program can be both a costly and Jong term effort which 
requires careful planning, coordination , and the cooper- 
ation of all concerned. 

It is essential to plan for some recognizable gain 
within the first two years, substantially more within the 
next two or three, and depending upon the extent and 
cost of the effort to achieve an increase in productivity, 
there should be still more gain within the next five years, 
A well-planned productivity program should have a 
substantial payoff within three to ten years. 

Implementing a productivity program, however, is 
not without some risks. If it is not well-pi aim=d, there is 
likely to be excessive optimism and overestimation of 
potential productivity gains. If the efforts are not well- 
coordinated, there may be only spotty success, resulting 
in little overall benefit to the organization. If it is viewed 
negatively, the workers may decide to thwart its imple- 
mentation, causing it to fail. And finally, unless there is 
cooperation between each level of management, profes- 
sionals^ clericals, end users, and others for whom the 
program is intended, there is little likelihood for success. 

Table S outlines the basic steps which should be taken 
to establish a Productivity Improvement Program 
within an organization. Adherence to this program will 
help ensure that the measurement of changes in pro - 
ductivity, using the metrics discussed earlier in this paper 
will result in definite gains in productivity from the 
introduction of current technology into an office envi- 
ronment. 



Summary and Conclusions 

While no definitive techniques for measuring pro- 
ductivity changes hi an functional workplace were identi- 
fied, this study did find overwhelming support for the 
idea that the introduction of microcomputers to the 
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functional workforce will result in significant im- 
provements in productivity. The "measurement" tech- 
niques employed have usually been highly subjective 
and sensitive to biasing factors which can make the cited 
statistics highly suspect. The most that can be concluded 
is that microcomputers appear to increase productivity 
and that this perception is very widely held. 

A few organizations have identified a set of measures 
unique to their environments. Some of these, as in the 
case of NSRDC, may be conceptually transferred to 
other environments. However, with the exception of 
traditional method of measuring inputs and outputs (be- 
fore and after), there are virtually no universally ac- 
cepted productivity measures for use in an office envi- 
ronment. 



Summary 

Our findings indicate that there are several key fac- 
tors which should be clearly understood when at- 
tempting to evaluate and measure the productivity 
within an organization. These findings are summarized 
below: 

• Few Effective Measures 

The measurement of changes in productivity in a pro- 
duction environment is a well-understood process; how- 
ever, the measurement of such changes in an office envi- 
ronment is much more difficult to quantify. While 
various methods have been proposed for measuring 
changes in productivity resulting from the introduction 
of microcomputers, very few are effective. 

The useful measures are those which primarily ad- 
dress qualitative aspects of the environment and the 
work produced. These measures are highly subjective 



and thus, must also be evaluated in light of the methods 
and techniques used to produce the measurements. 

• Qualitative Measures Should Be Global 

Too often, an attempt is made to measure productivity 
at the atomic or detailed level. The introduction of mi- 
crocomputers may affect how and what individuals in 
an organization do to varying degrees. Indeed, the ac- 
tual work (throughput) of some individuals may appear 
to decrease. While this would seem to contraindicate the 
use of microcomputers in this case, an examination at a 
higher, macro level, may show that there has been a 
resultant overall improvement in productivity. 

The key to a successful productivity improvement 
program is to define what is expected in terms of pro- 
ductivity gains, specifically, what and how to measure, 
and then proceed. The best measurements of pro- 
ductivity changes in an office environment are qual- 
itative. These measures are the most accurate when em- 
ployed at an organizational level. It should be clearly 
understood that the goal of any productivity program is 
to improve the overall productivity of the organization. 
Thus, the measurements should be made at the global 
level and indications of increases or decreases in pro- 
ductivity at individual levels should be evaluated within 
the context of the productivity changes of the entire 
organization. 

• Measurements Must Be Made Against an Estab- 
lished Baseline 

Results of measurement techniques can be highly sus- 
pect since the items being measured or counted are often 
subject to various conflicting interpretations. Regard- 
less of the method or technique used, it is essential to 
measure changes in productivity against an established 
baseline. The questionnaire method appears to be the 
most useful in obtaining, comparing, evaluating, and 



Table 8. Establishing a productivity improvement program. 



1. Determine how the tasks/jobs ate currently done. 

2. Determine where performance can be improved. 

3. Define the level of productivity gain expected. 

4. Perform a cost-benefit analysis to determine if this is a feasible expectation. 

5. Understand that introducing automation requires significant up front costs. 

6. Take future inflation into account. 

7. Determine the amount to be committed to achieve productivity gains. 

8. Determine for whom equipment will be used. In white collar domains, there are clearly two sets of users: professional and 
clerical. 

9. Determine for which applications equipment will be used. 

10. Determine what kind of equipment will be used. 

11. Evaluate large, difficult to maintain programs for possible replacement with off the shelf packages. 

12. Evaluate activities that require substantial resources, i.e., OR, simulation, job scheduling, for possible replacement by more ef- 
ficient ones. 

13. Run a pilot to substantiate the expected improvements. 

14. If the pilot is successful, go forward with the whole program. 
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measuring relative changes in productivity against a 
baseline. This method provides for gathering informa- 
tion on qualitative, as well as quantitative changes in 
productivity. 

* Allow Sufficient Time Before Measuring Productivity 
Changes 

The introduction of any new technology involves a 
learning period during which there may actually be a 
decline in productivity. On the other hand, the ex- 
citement of being involved in an "experiment," such as 
the introduction of microcomputers in an organization, 
may also lead to an increase in productivity. The effect, 
however, may be more pronounced immediately after 
the introduction of microcomputers than later. Con- 
sequently, sufficient time must be allowed after micro- 
computers are introduced into the organization to per- 
mit a stable state of operation to be established before 
the productivity impact is assessed. 

• Measurements Should Be Carefully Evaluated 

Improper or undisciplined use of microcomputers can 
be counterproductive due to the wrong work being 
done or to new work being created which is not needed. 
Thus, the measurement of the effects of microcomputer 
use should be carefully evaluated. Care should be taken 
to evaluate the impact on the entire organization, not 
just the directly affected individual. In addition, mea- 
surements must be made over a long enough time period 
to balance any short term drops or rises in productivity. 
Microcomputer use within the organization decen- 
tralizes the computing resources and enables users 
(ADP professionals as well as those without previous 
ADP experience) to be in direct control of their infor- 
mation processing activities. The user has a wide range 
of information on which to base decisions and can make 
those decisions quickly and accurately. Consequently, 
the user can perform his job more efficiently and effec- 
tively. While microcomputers are frequently used as 
stand alone, general purpose tools, they are rapidly be- 
coming a means of accessing the large scale systems and 
other microcomputers. The link between the micro- 
computer and mainframe provides the user with broader 
range of capabilities and greater potential for pro- 
ductivity gains. The result is the work being done faster, 
the quality of reports and other documents is improved, 
and work is performed which was previously not possi- 
ble. 

Conclusions 

The primary purpose for measuring changes in pro - 
ductivity resulting from the use of microcomputers is to 
provide evidence of their cost-effectiveness and impact 



on the organization. This can be accomplished in a num- 
ber of ways ranging from a cursory examination of ac- 
tivities and products before and after the introduction of 
microcomputers, to a plan which encompasses the rec- 
ommended methodology outlined in table 6. We 
strongly recommend the use of this methodology to 
determine first, whether to initiate a measurement pro- 
gram; and secondly, how to go about performing the 
measurements. 

A significant number of Federal Government and pri- 
vate sector organizations have introduced micro- 
computers and subsequently, have been able to identify 
gains in overall productivity. Although many of these 
organizations introduced microcomputers without the 
benefit of a prior productivity measurement study or pro- 
gram, evidence of their cost effectiveness and impact on 
the organization has come from both managers and end- 
users. The management of these organizations is con- 
vinced that improvements in products, services, effi- 
ciency, morale, and numerous other areas occurred as a 
result of using microcomputers. 

Prior to initiating a study or program to measure 
changes in productivity, some consideration should be 
given to the feasibility and cost benefits of such a pro- 
gram, (see step 1 of table 6). If it is determined that a 
productivity measurement program is not feasible, or if 
there is little or no assurance that such a program could 
be justified from a budgetary standpoint, then it may be 
better to rely on the judgement of the managers and 
users of the microcomputers. 

Therefore, while a study or program to measure 
changes in productivity as a result of using micro- 
computers may be a worthwhile endeavor, it is not nec- 
essary or appropriate for every environment. 
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